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PREFACE 



The Board on International Comparative Studies in Educa- 
tion was established in 1988 at the request of the U.S. National 
Center for Education Statistics and the U.S. National Science 
Foundation. The board operates under the aegis of the Com- 
mission on Behavioral and Social Sciences and Education of 
the National Research Council. The board monitors U.S. par- 
ticipation in cross-national comparative studies in education 
that are funded by its sponsors and provides advice to the 
sponsoring agencies. In carrying mit its responsibilities, the 
board provides a forum for information and discussion; assists 
in planning the conduct and funding of international studies; 
establishes principles regarding the quality of study design, 
data collection and analvsis procedures, and report prepara- 
tion; encourages dissemination of study findings; promotes the 
use of assessment findings to improve U.S. education; and pe- 
riodicallv suggests studies that would be useful additions to 
agencies' plans for U.S. participation in international studies. 

This document is the result of acti\*ities of the board in 
considering studies that would enrich the agencies' plans. In 
assessing the feasibilitv of a new international study, it is es- 
sential to consider the interest and willingness of other coun- 
tries to participate in the study. At present, worldwide ar- 
rangements for planning and conducting cross-national research 
and data collection in ediicaticMi are inadequate. Responsibil- 
ity is fragmented among many organizations in many coun- 
tries and, consequently, there is no easy way to assess the fea- 
sibility of a stud\'. Since reliable information based on sound 
cross-national research and data collection can be useful in im- 
proving educational practices and outcomes in the United States 
as well as in other nations, members of the board believe it is 
important to establish a coherent and effecti\'e worldwide sys- 
tem to develop such information. 

This document includes discussion of what the board per- 
ceives to be the \aluo of international comparatixe studies in 
education and its views on how these studies cc>uld be im- 
proved. It also includes a challenge to go\ ernments and lead- 
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ers in education to form alliances to dev'elop the information 
needed to improve educational outcomes and practices; it also 
suggests a possible approach to meet the challenge. The board 
hopes that this document will encourage interest and a wilh 
ingness to engage in this work by suggesting a vision of what 
international comparative research and data collection might 
produce in the next 20 years. 

The board began with several discussions of this vision and 
of current international data collections. To serve as a further 
catalyst in encouraging the development of a worldwide sys- 
tem for planning and conducting cros.)-naiional research and 
data collection in education, the boa/d convened an Interna- 
tional Conference on Long-Range Planning for Large-Scale Col- 
lections of International Education Statistics in Paris in June 
1992. Participants included representatives of intergovernmental, 
governmental agencies, and nongovernmental organizations. 
An earlier version of this document was prepared as a basis for 
discussions at the conference. Key topics for discussion in- 
cluded agenda items for cross-national research for the next 
10-20 years, improvement of infrastructures for cross-national 
research, and cooperative efforts that might be taken to meet 
the data requirements for the next decade. The conferees agreed 
that it would be useful to meet again to discuss cooperation 
between organizations and strategies for the development of a 
consortium or a new international network for long-range planning. 

Therefore, the board, in conjunction with the United Na- 
tions Educational, Scientific, and Cultural Organization (UNESCO) 
and the International Academy of Education (lAE), convened a 
second internaticMial conference in Washington in January 1993. 
At the secemd conference, kev discussion topics included the 
status and problems of international education statistics as well 
as challenges and prospects for international cooperation in 
education statistics and research. Participants agreed to con- 
tinue and further the cooperation that has begun with these 
two conferences. Colin Penver, UNESCO assistant director general 
for education and LINLSCO representatix e to the conferences, 
agreed that UNESCO would ser\e as the central organization 
for collecting informatiem relating to these activities. Jacques 
Hallak, director, International Institute for Educational Plan- 
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ning, offered to host a third international conference in Paris in 
summer 1993. Several participants agreed to carry out various 
activities to prepare materials for the third meeting. With this 
second conference, the board concludes its role as a catalyst in 
stimulating international coordination for research and the col- 
lection of data, although it retains substantial and continuing 
hopes for the success of these enterprises. 

This document reflects the collective thinking of the board. 
The first draft was the result of a hard day's work by three 
working groups comprising the entire board. The draft was 
then reworked by board members Judith Torney-Purta and John 
Schwille and staff director Dorothy Gilford. These people de- 
serve a special note of thanks for turning several disparate 
pieces into a coherent draft. This draft was then discussed and 
further revised by the board and reviewed by over a dozen 
members of the education research community. I wish to thank 
all the board members who contributed to the stimulating dis- 
cussions that led to the document as well as all the reviewers 
who took the time to send their reflective and cogent com- 
ments. 

1 am also grateful to Laura Lathrop, research assistant, and 
Jane Phillips, administrative assistant, who assisted Dorothy 
Gilford throughout the preparation of consecutive drafts of the 
document and to Christine McShane, editor of the Commission 
on Behavioral and Social Sciences and Education, whose highly 
professional editing contributed greatly to its readability. 

Michael W. Kirst, Cluiir 

Board on International Comparative 

Studies in Education 
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A COLLABORATIVE AGENDA FOR 
IMPROVING INTERNATIONAL 
COMPARATIVE STUDIES IN EDUCATION 



Interest in international comparisons in education has in- 
creased rapidly over the past two decades, perhaps now ex- 
ceeding that of the earlier era of public discussion in the late 
1950s that was stimulated by the successful launching of Sput- 
nik. This renewed interest offers both potential benefits and 
considerable risks. Earlier research has been cited in the press 
and in reports prepared for policy makers, but much of this 
public discussion has been selecti\’e, overly simplified, and a 
poor guide to public policy making. The increasing scrutiny of 
earlier studies has revealed their limitations and the conse- 
quent need for improvement in the planning, execution, and 
dissemination of international comparativ'e research. 

If the situation is to be improved, the tasks of establishing a 
more coherent and effective worldwide system for cross-na- 
tional research and data collection in education must be shared 
among many organizations in many countries. This document 
does not presume to set the agenda for international research, 
or even to indicate the priorities for such research — activities 
that would be appropriately carried out only within the frame- 
work of a worldwide system for cross-national education stud- 
ies. This document was prepared to stimulate interest and a 
willingness to engage in establishing such a system by sug- 
gesting a \ ision of what international comparative research and 
data colie tion might produce in the next 20 years. 

By the vear 2010, this vision calls for those with an interest 
in learning about education in other countries to have access to 
the following sources of data, information, and analysis; 

• A set of widely accepted and widely understood indica- 
tors of the status and conditions of education in various coun- 
tries;’ 

•sonu' im-inlvrs ol llu‘ lomfMi dti\ o ciliuTitu'n >mimmil\ quostioti \Uv iiscluliu*ss ol 
nuiu«iti>r. llu-v qul‘'^^lon u-hrUuM' llu* biMUTits siuli uulualors prodiui* aiv uorih tin* 
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• Syntheses of empirical research throughout the world, 
bringing such research to bear on broad comparative questions 
of wide interest; 

• Specialized comparative monographs on questions of im- 
portance and interest to all educators; 

• Documentation of teaching practices and school organi- 
zation in a form that will be stimulating and useful for discus- 
sion and study by specialists and nonspecialists, including, for 
example, videotape archives of a wide range of classroom practice; 

• Widely distributed publications of comparative infor- 
mation on issues of public policy, written in nontechnical lan- 
guage and responsive to the interests of journalists and the 
public; 

• Routine translation, distribution, and use of primary docu- 
ments, such as textbooks and syllabi, when these documents 
are sufficiently distinctive and important to be of interest to 
educators outside the country of origin; and 

• Archives necessary to strengthen the methods used in 
cross-national studies, including both technical reports on what 
works methodologically and banks of instruments, items, and 
other applicable research elements and models for a variety of 
cross-national studies. 

This document is primarily intended to focus attention on 
the nature of collaborative efforts to attain the vision. It in- 
cludes discussion of the value of international comparati\'e studies 
in education; how they could be improved; and a suggestion 
for consultation anci forming alliances among potential C('>llabo- 
rators. 



WHAT IS THE VALUE OF INTERNATIONAL 
COMPARATIVE STUDIES? 

Why should the United States or other countries be inter- 
ested in supporting or participating in international education 



cost, ,imi tlu‘\ ofo totuorncd thdt tlic financiiil «nul pohtic«il cost ot producing truly 
compiiroblo indicoti^rs c\cc‘. Js the polilicdl willingness ot ninnv countries t(> subject 
their ediicotionul svsti'm to the poti'ntitill y hurs-'. a^mpurison lluit would ensue. 
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studies? From the Board on International Comparative Studies 
in Education's viewpoint, the naost important reason for U.S. 
participation in international studies of education is to improve 
understanding of our own education system (Bradburn and 
Gilford, 1990). Since the philosophy, organization, and prac- 
tice of education varies across cultures and societies, a com- 
parati\'e perspective will increase our understanding of its many 
forms. Every aspect of education might benefit from compari- 
son, from issues of teaching and learning, to matters of cur- 
riculum and organization, to broader issues of education policy. 
Since there a.e no absolute standards in education, comparison 
informs the standard we set for our children. Comparative 
studies also help policy makers monitor the success of educa- 
tion systems. And given that many people are reluctant to 
conduct controlled experiments with our children's education, 
comparison of natural variation is usually the most feasible 
way to study the effects of differing policies and practices.- 
Nevertheless, much of education research is parochial, un- 
informed bv the comparative knowledge that cross-national 
education research can provide. Researchers should be en- 
couraged to develop broad and in-depth knowledge about cross- 
cultural similarities and differences and similariti».s in the way- 
people learn. They should also undertake studies that exam- 
ine the context of and participation in formal and informal 
education at all lex-els. Research is also needed to generate 
more i"\arrowly focused knowledge that speaks to pressing prob- 
lems of practice, such as identifying pedagogies and schools 
that best help children at risk to avoid becoming diopouts or 
knovx'ing the role of algebra in curricula designed for today' s 
students and how they learn it best. 

It would be important, therefore, to seek ways to engage 
education researchers, practitioners, and consumers in the search 



^Sonu‘ critics h.u c notcil, ho\\c\er, th*U ci'ntrollcd experiments h*n e the potenti«)l to 
impriue tiu' methoili>li)^iCtil sensili\ it\‘ ot e'.liuMtion stiulicb. I^i'commeniliitions tor 
griMlei' nsi* i>f i*\perimenl<il inellu'its tue iltsiusseil in recent \«Uion«)l Kese»)tchC I'lnuil 
report on hilin^iuil eductition siiultes (Nteyer «nut 1-ienherj;. An exclusive reh- 

«ince on correl»Uion»il research designs ,nul iLitu «inol\sis lechniijues is ^\ nietluulolOi;i' 
celK limited outlook. I hits, it is imporl.mt to continue to wei|;h the pros .ind cons ot 
the «in;uinents ,i^«unst con trt>IU’d educ«ilion experiments. 
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for international comparative understanding of what educa- 
tion is and how it should be judged. Researchers should capi- 
talize on what can be learned from a natural worldwide labo- 
ratory of education systems, which over generations have come 
to embody many important differences in opportunities to learn, 
students' desire to learn, curricular structures, and teaching 
practices. Addressing these differences involves making infer- 
ences about what different cultures and organizations around 
the world consider to be excellent outcomes and excellent practice. 
Education policy makers should focus on success wherever they 
find it and could also learn from what does not seem to work. 
It is especially important to seek data over time in order to 
examine trends and the impact of changing contextual condi- 
tions. In addition, the collection and sharing of the artifacts of 
education (e.g., textbooks, children's writings, teachers' jour- 
nals, and videotapes of classrooms) should be encouraged so 
that discussions of education in other places and at other times 
can give the users of such artifacts a better sense for the social 
texture and cultural intricacies that are so central to knowl- 
edge of teaching, learning, and human development. 

The balance of this section focuses on the two broad types 
of international comparative knowledge about education; each 
type satisfies different needs for information. First is the knowledge 
needed to address issues of policy and practice currently on 
the public agenda. Approaches in this category focus on prob- 
lems for which researchers have arrived at a working defini- 
tion and for which they seek alternative solutions to compare 
and evaluate. Second is knowledge without reference to a par- 
ticular current problem or issue — such knowledge is gathered 
to enhance general understanding in the long term. 

Responding to Particular Policy Needs 

An important purpose of cross-national research is to re- 
spond to particular policy needs. For example, an issue of 
particular importance to U.S. policy makers at present is whether 
all our students have been gix’en adequate opportunities, ap- 
propriate standards, and justifiable expectations for learning, 
relative to what is done in other countries. In this respect, it is 
important to examine out-of-school opportunities as well as 
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those provided by schools. Questions range from "What can 
be expected of our best students?" to "What can be done about 
students who are poorly prepared and poorly motivated?" In 
short, what can be done to make sure that all students truly 
have adequate opportunities to learn? 

Such policy issues can be addressed in three ways: 

• Tracking progress within and among nations; 

• Comparing the quality of education offered while expli- 
cating and attempting to understand its context; and 

• Initating policy-driven comparative studies of education 
institutions and practices. 

Tracking Progress 

The lack of an adequate system of education indicators to 
inform education policy making has become increasingly ap- 
parent. Data are not collected regularly, systematically, or with 
enough coordination either to satisfy natural curiosity about 
education svstems around the world or to answer the ques- 
tions of researchers and policy makers about changes over time 
in education in a variety of countries. Trend data are needed 
on many aspects of education. We illustrate with three types 
of trend data that are needeci: 

WIint children in other countries arc Icnrniii;^. International 
comparisons provide comparisons beyond the limits of U.S. 
national experience. Tor example, recent studies have shown 
that students in other countries study some mathematics topics 
at an earlier age than students in the United States and that 
consequentlv it may be feasible to modify U.S. curriciila ac- 
cordingly. In the absence of absolute standards for education, 
comparisons help policN' makers set realistic standarcis. Peri- 
odic collection of data from a diverse group of countries can 
serve both descriptive and monitoring purposes (Bradburn and 
Gilford, IWO). 

l-iu toifi Hint nmi/ he rclntcd to iichool nchicivnicnt. Information 
from different countries on policy-manipulable variables that 
are associated with student performance can identity potential 
policy impro\’ements. Such variables include the time that children 
in other countries spend studying important subject matters 
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such us mathematics, science, mother tongue, history, and for- 
eign languages; the knowledge and expertise teachers bring to 
their work; and classroom size. 

School fiiuvicc ilntn rclah’d to the dcUvcnj of education. Educa- 
tion expenditures such as teacher salaries, expenditures for in- 
service and other continuing education for teachers, expendi- 
tures on textbooks and other instructional materials, expenditures 
for special services, and class size (a determinant of the total 
expenditure for teacher salaiies) can reflect x’arious education 
policies. Education policy makers find it useful to compare 
trends in these indicators for the United States (a reflection of 
U.S. education policy) with trends in these expenditures for 
various countries that have education policies different from 
those in the United States, although the data must be used 
with caution because of the difficulties in obtaining compa- 
rable financial data. 

Not only should national averciges and other measures of 
central tendency be investigated, but also indices and graphic 
representations of \ ariation within and between countries and 
trends over time as they become available. 

International agencies have begun to prox ide information 
to answer questions about some aspects of education. For the 
past three decades a nongovernmental consortium known as 
the International Association for the Evaluation of Educational 
AchievemenU(lFiA) has endeaxored to fill a major gap bx' pro- 
viding cross-national data on educational achievement, aug- 
mented bx' extensixe information concerning the curriculum, 
classroxim process, and other contextual information necessary 
to its interpretation. lEA studies haxe covered a broad range 
of topics: mathematics, science, reading K'eraev, written com- 
position, literature, English as a foreign language, French as a 
foreign language, cix ic education, classroom enx ironment, com- 
puters in education, and early childhood care and education. 
11- A has not identified or attempted to deal with all the impor- 
tant issues that should be addressed bv indicators, nor has it 
been sufficiently well financed or well organized to set up regularly 
scheduled international assessments in all important school subject 
matters. Recently, hovvex er, II- A has released plans for a schedule 
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of 4-year cycles of studies that provide for reports; a cycle for 
mathematics and science with main data collection in 1995, a 
language cycle starting in 1995 and alternating between second 
or foreign language and reading literacy, a cycle starting in 
1997 alternating between civics and the arts, and a cycle of 
special studies such as preprimary education or computers in 
education starting in 1998. 

The Organization for Economic Cooperation and Develop- 
ment (OECD) has organized an extensive effort, growing out 
of preparatory conferences held in 1987 and 1988, to plan for 
the development of comparable education indicators across its 
member countries. Six networks were formed to deal with 
student achievement, education and labor market participation, 
features of school systems, attitudes and expectations, student 
flows, and costs and resources. Participation in these networks 
ranges between 6 and 20 countries. In 1992, OECD published a 
first set of international education indicators (OECD, 1992) de- 
veloped by the Centre for Educational Research and Innova- 
tion (CERl). It provides comparative information for the OECD 
countries for three clusters of indicators; the demographic, 
economic, and social context of education systems; costs, re- 
sources, and school processes; and outcomes of education. Fu- 
ture publications of OECD indicator data, which are expected 
to be published at about 16-month intervals, will establish im- 
portant trend information on OECD education systems for use 
bv policy makers. 

The United Nations Educational, Scientific and Cultural Or- 
ganization (UNESCO) also collects country data on key aspects 
of education in over 160 countries. During the 1950s and 1960s, 
UNESCO issued a periodic publication, A World Survey of Edu- 
cation, which provided statistics on the state of education through- 
out the v.'orld. In 1992, UNESCO published World Educatiou 
Report 1991 (UNESCO, 1992), the first in a new biennial series 
that will present major trends and current policy issues in edu- 
cation. Focusing on basic education, the 1991 report describes 
world education growth since 1970 and includes information 
on demographic trends, adult literacy, participation in formal 
education, teachers, and finance. 1 he report highlights basic 
education and continuing challenges in that area. Looking to- 
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ward the future, the report identifies two major issues; teach- 
ers and teaching (e.g., the need for additional teachers, recruit- 
ment, and training) and the assessment of students' learning 
achievement (e.g., school-based assessment, changes in assess- 
ment practices). The report includes education indicators for 
the years 1980 and 1988, thereby providing measures of change 
in education characteristics, for over 160 countries on a num- 
ber of topics: population and gross national product; literacy, 
communications, and media; school entry and participation; 
enrollment ratios and internal efficiency in first-level educa- 
tion; enrollment ratios in second level education; teaching staff 
in preprimary, first- and second-level education; enrollment 
ratios and number of teachers and students in third-level edu- 
cation, as well as students by broad field of study for 1988 
only; public expenditure on education and private enrollment; 
and current public expenditure on education. 

These OECD and UNESCO reports are welcome additions 
to education information. In planning for future indicator sets, 
a 1991 report by the Special Study Panel on Education Indica- 
tors for the U.S. National Center for Education Statistics (NCES, 
1992) is particularly rele\'ant. The fi\ e principles advocated in 
this report and listed below were de\'cIoped for national indi- 
cator sets, but thev could be applied to cross-national sets as 
well; 



• Indicators should address enduring issues. Although a 
model for indicator de\'eIopment oriented to education goals 
(i.e., define goals, specify objectives related to the goals, and 
de\ eIop indicators to measure progress tow'ard the objectix'es 
and goals) could be used, it would lose its value o\'er time as 
goals change. Researchers should assess what thev think is 
important, not settle only for what they can measure. 

• The public's understanding of education can be improved 
by high-quality, reliable indicators. 

• An effective indicator system must monitor education 
outcomes and processes vvhere\^-r thev occur (not just in schools). 

• An indicator system built solely arouml achie\ ement tests 
will mislead the people in the United States. 

• An indicator system must respect the complexity of the 
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education process and the internal operations of schools and 
colleges (National Center for Education Statistics, 1991;19-21). 

Moreover, for use in informing policy and practice, sets of 
indicators are more useful than individual indicators, and these 
sets must be developed for a specific context, form, and level 
of education. 

Comparing Quality While Understanding Context 

The interested layperson naturally wants to know how the 
quality of education in the United States compares with that of 
other countries. Often this concern is addressed in ways that 
pay scant attention to the complexities of education and the 
particular contexts in which children are educated. Cross-na- 
tional studies in education have attempted to deal with this 
dilemma by developing methods and measures that avoid com- 
paring the incomparable. Thus, for example, the concepts and 
measures developed for lEA studies include; the intended cur- 
riculum (what the curriculum specifies), the implemented cur- 
riculum (what the teacher actually taught), and the attained 
curriculum (the student performance on a test of content). This 
refinement represents one way to achieve more comparability 
in the explanation of achievement outcomes (although much 
more improvement is called for in the implemeiTation of these 
curriculum measures). In general, a great deal of additional 
work on explanatorv’ variables is needed to increase the com- 
parability of education processes and outcomes. 

Still another approach to dealing with the difficulties ot 
compa rability is illustrated by earlier ll:/\ researcli that focused 
on how to adjust results to take account of more and less selec- 
tive secondary school systems to avoid comparing the elites ot 
one system with a larger mass of students in another. The goal 
i)f these studies was to help policy makers cctnsider the advan- 
tages and disadvantages of a more or less comprehensive sec- 
ondary school system. The findings were used to support policy 
changes making a number of secondary school systems moix' 
comprehensive (e.g., Marklund, halhiiry, I9S9), 

Curriculum and seleclivitv ditterences are not ihe only is- 
sues in understanding the context foi cross-national compari- 
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sons. Similar issues include differences in language spoken, 
religion, laws, implements (e.g., tools, utensils, instruments) 
used, and values held, as well as attitudes toward testing that 
might influence motivation. Differences in cultural context can 
affect what is taught and when it is taught. Research is needed 
on the effects of these cultural differences on student achieve- 
ment and the development of a theory explaining the contex- 
tual difference among nations. 

Policy-Driven Comparative Studies 
of Educational Institutions and Practices 

U.S. national education goals for the 1990s have provided 
strong motivation for continued interest and discussion of cross- 
national comparisons in mathematics and science (U.S. Depart- 
ment of Education, 1991). Additional motivation has been pro- 
\'idod by the Goals 2000: Educate America Act (introduced in 
the U.S. House of Representatives and the U.S. Senate), which 
formally establishes the education goals and calls for a Na- 
tional Education Goals Panel and a National Education Stan- 
dards and Improvement Council, which would develop model 
standards for student performance, curriculum, and school quality 
(H.R. 1804 and S.R. 846, 1993). Se\’eral implicit causal assump- 
tions underlie public and political interest in cross-national studies 
of mathematics and sciene'e: (1) increased and impro\'ed cur- 
ricular emphasis on mathematics or science in precollegiate edu- 
cation for all students will result in greater achievement for a 
greater number of students; (2) this will result in a greater 
number of better prepared students entering the natural sci- 
ences and engineering; and (3) this will in turn lead to a greater 
number ot more productive scientists and engineers in the la- 
bor force. A final assumption is that more and better scientists 
and engineers will increase economic growth or producti\ity. 
Each of these premises has its critics, and each could be more 
systematically evaluated. At a minimum, conferences should 
be organized to ensure that all reasiMiablv well-informed par- 
lies with opinions on such issues are heard, repi>rts should be 
issued, and, il possible, strategies should be dexeloped to kei'p 
tin' contending parties from speaking past or ignoring one another's 
point of \ ii'w. 
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However, a focus on mathematics and science is not suffi- 
cient; other subjects are also important. It is critical to ensure 
that the complexities of education, including its variation across 
contexts and multiple content areas, are taken into account. 
Virtually e\'ery policy issue can be illuminated through study 
of how policy and practice vary among countries. For example, 
recent cross-national comparisons highlight gender differences 
and similarities at both the individual and societal levels of 
analvsis. These studies can facilitate our understanding of the 
implications of the gender gap in academic achievement (e.g., 
they allow us empirically to evaluate arguments that suggest 
that more centralized education systems are more equitable 
and/or more efficient). These studies also help us understand 
the effects on economic growth of the expanded access of women 
to varying levels of education. Data from the studies can be 
used to evaluate arguments that suggest that the undereducation 
of women negatively affects economic growth (King, 1990). 

The range of issues ripe for comparative inquiry includes 
questions of finance, decentralization versus centralization, the 
professionalization of teachers, the need for formal programs 
of teacher education, the effects of education on productivity, 
the effecti\ eness of measures whose goal is to enhance educa- 
tion opportunities for minoriU' populations, the value of bilin- 
gual education, differing mixes of public and private schools 
(including religious schools), and even the feasibility of em- 
phasizing moral education in public schools. Although much 
has been said abcnit the world's constituting a natural labora- 
tor\', in fact the availabilitv to U.S. audiences of current, rel- 
evant, and in-depth informatitm on policy issues in other countries 
remains far too limited. Although it is true that studying edu- 
cation in other countries will not tell us what we to do, 

such stud\' will help us to become clearer about what we value 
and the police options for putting these values into practice.' 

What does it mean to pinpoint areas in which cross-na- 
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tional differences are important to education policy and prac- 
tice and to attempt to provide reasonably persuasive explana- 
tions for such differences? Heretofore, this goal has meant an 
attempt in cross-national surveys to estimate how much edu- 
cation outcomes are affected by factors controlled through edu- 
cation policy. This effort has been motivated by the idea that 
comparisons of achievement levels are not meaningful unless 
one can, first, identify the educational inputs and processes 
that contribute to observed outcome differences between coun- 
tries; second, make some estimate of the contribution of each 
educational input to realized outcome levels, and third, con- 
sider how these effects \ary bv context. 

But surveys by themselves are not adequate. They have 
focused too much on narrow measures of achievement, neglecting 
other important outcomes. They are not very sensitive to con- 
textual differences, and as a result it is often very difficult to 
give plausible explanations for observed differences. The com- 
plexities and difficulties of acquiring a more adequate under- 
standing of education in other countries and its possible impli- 
cations for the United States can be illustrated bv looking at 
japan. Since progress has been made in U.S. understanding of 
Japanese education, let us look carefully at how this under- 
standing has e\*olved, at what has been learned, and at the 
gaps and ambiguities that remain in understanding. Turning 
back to the increasing exposure to Japanese education over the 
past 20 \ ears, it becomes clear that there are different phases, 
which ha\ e gradually led to more, though still inadequate, com- 
parati\ e understanding. 

During the 1080s, policv makers became aw'are that achiex e- 
ment levels on conventional multiple-choice tests in mathematics 
and science w'ere higher for Japanese than for U.S. students at 
certain grade levels. For example, the IHA Second Interna- 
tional Mathematics Study, which gathered data in the 1081-82 
school vear, reported that Japanese eighth-grade students con- 
sistentlv scored hight r than studeiUs in other countries in arith- 
metic, algebra, geometrv, and measurement, w'hereas U.S. stu- 
dents scored in the middle ot the group of countries on arithmetic 
and algebra and below the international axerage on geometrv 
and measurement (McKnight et al., 1087:20-22) In science, in 
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grades 5 and 9, Japanese students also scored at the top of the 
group, although at grade 12 their scores were lower (Interna- 
tional Association for the Evaluation of Educational Achieve- 
ment, 1988:7, 26-27, 32-36, 48-54). This awareness was accom- 
panied by debates ov'er the significance of and reasons for such 
results. There was much disagreement over whether these 
measures were meaningful when taken in isolation from other 
evidence about education outcomes. These debates stimulated 
public interest, yet they were initially largely uninformed by 
further empirical research on these issues. 

Gradually, however, there have been more focused and data- 
based studies that were intended to provide more in-depth 
understanding of Japanese practices (e.g., stud'es by Cummings, 
Peak, Rohlen, Shimahara, Stevenson, Tobin, and others). As a 
result, relatively uninformed endorsement or rejection of Japa- 
nese practices has partially yielded to attempts to explain these 
practices more thoroughly within the Japanese cultural con- 
text. More attention has been directed to the many interactive 
factors that might influence a particular practice or outcome, 
such as the amount of time spent on a task or on homework, 
teacher quality, and parental beliefs about the relative impor- 
tance of factors influencing success in school. 

As such studies become more generally known, non- 
comparatix ists can be expected to cite these findings more fre- 
quently and to incorporate them in a more general understanding 
of mathematics education. Perhaps in the near future there 
will even be a sizable market for publications about how math- 
ematics and science are taught in Japan as well as other topics. 

To the extent that such writings bear fruit in explicating 
practices that are effective in Japan, there will inevitably be 
more debate about whether similar effects might be anticipated 
in the United States. Although the borrowing of educational 
policies and practices is much criticized for infringing on cul- 
tural values and indigenous practices and for its undeniable 
risks of unintended consequences, it can also positively influ- 
ence classroimi practices. It has been and will no doubt remain 
widely attempted in education. 

The same principles, in many respects, apply to other coun- 
tries and subject areas. Howex'er, it is \'ery difficult to carry 
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out multivnricite analysis of natural variation that is reliable 
and valid. For example, the high scores of Japantfse eighth- 
grade students relative to those of the U.S. students in the lEA 
Second International Mathematics Study raised questions about 
the quality of precollege mathematics teachers in the United 
States. But, although poor student outcomes may be corre- 
lated with teacher quality in terms of training characteristics or 
classroom method, the cause may be due to factors unrelated 
to teacher quality, such as the curriculum, time spent on math- 
ematics topics in school, and the influence of the home envi- 
ronment. The effects of all these factors on student achieve- 
ment need to be understood before we understand the relative 
performance of Japanese and U.S. students. Although interna- 
tional studies have provided detailed information on student 
achievement in various subjects in many countries, the causal 
analyses of the comparative results have been inadequate. 
Advances in survey analytic techniques, such as hierarchical 
linear modeling, offer promise of addressing thos*’‘ weaknesses. 

Long-Term Development of Knowledge 

A second important purpose of cross-national research is 
the long-term development of knowledge. Scholars often gather 
knowledge for its own sake, sometimes to expand the knowl- 
edge base in their field and at other times to develop their 
capacity for grasping trends and- advancing ideas. In the long 
run, this exploration enriches and expands their understand- 
ing of the world and its complexities. They make an intellec- 
tual investment, to be drawn on later, as they interpret their 
research findings and the results of other related investiga- 
tions. 

To underwrite such investments, it is important to collect 
cross-national data at societal levels over reasonably long peri- 
ods of time. Such data facilitate the identification of world- 
wide, regional, and national trends and permit analysis of the 
sources and effects of cross-national variation in education or- 
ganization, policy, and practice. Systematic cross-national in- 
quiry, motivated by theory and carried out ox er time, is needed 
to discourage parochial folkhnv and inappropriate inferences 
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rooted in a spatially and temporally limited vision of what 
education is as well as what it could or should be. 

More specifically, long-term development of knowledge can 
affect comparative inquiry in a number of important ways: 

• Becoming more cumulative and theoretical by provid- 
ing synthetic works and bringing about consensus on a cross- 
national system of indicators, which in turn will illuminate 
changes across time; 

• Highlighting areas in which cross-national differences 
are important to education policy and practice as well as pro- 
vide reasonably persuasive explanations for such differences; 

• Stimulating the development of a comparative dimen- 
sion within all major educational specialties (e.g., empirically 
based comparative education has had far too little to say about 
the realities of classroom practice); 

• Communicating the state of comparative education knowl- 
edge more effectively than at present to nonspecialists so that 
the thinking and discourse of educators in other fields will, as 
a matter of course, be informed by international comparative 
studies; 

• Drawing attention to potential w'eaknesses or strengths 
of education systems; 

• Identifying models or practices of education in other 
countries that have rarely, if ever, been used in U.S. education; 
and 

• Expanding the categories and solutions that researchers 
consider when they think about education problems and thereby 
contribute to the contextual understanding of education. 

In designing and carrying out such long-term efforts, a bet- 
ter understanding will be gained not only of contextual varia- 
tion in education policies, institutions, and practices and their 
''ffects on learners, but alsc^ of more fundamental aspects of 
human and social development, including: 

• The developmental processes of children, \ outh, and adults 
and the implications of these processes feu* learning; 

• Education issues related tc> gender, race, and social class; 
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• The importance of cultural values in shaping the identi- 
ties for which children are educated; and 

• The role of education in relation to subsequent social 
and economic stratification in adult life. 

Knowledge of a nation's education system will reveal what a 
nation values in its people. Is education for some or for all? 
What cultural norms does the education system embody? Are 
assumptions made that some people are unworthy of educa- 
tion investment? What are the personal and national payoffs 
of formal schooling? Who are the intended beneficiaries of the 
system, in addition to students? Such issues are of paramount 
importance in considering how nations determine who is to be 
educated, what is to be learned, and how all this can be accom- 
plished. The central role of teachers in the success of an edu- 
cation program should be studied, as should issues concerning 
their recruitment, retention, training, rewarding, development, 
and deployment. Equally important are issues related to for- 
mal and informal sources of control and autonomy. 

HOW CAN INTERNATIONAL COMPARATIVE STUDIES 

BE IMPROVED? 

It is important to conserve and accumulate whatex'er knowledge 
and experience is needed for the betterment of future com- 
parative international studies. In particular, since advancing 
the science and technology of cross-national comparative edu- 
cation research is a legitimate end in itself, both theoretical 
and empirical research aimed directly at methodological im- 
provement should be encouraged. 

To improve the w'ay such knowledge is gathered, interpreted, 
and used, a number of topics that require attention are dis- 
cussed in the sections that follow; research design, data analy- 
sis, and dissemination; methods for assessing current and de- 
sired outcomes of education; comparability across nations and 
ways of interpreting differences within varying contexts; use 
of ethnographic and historical studies to strengthen investiga- 
tions using statistical analysis and to provide in general a deeper, 
richer sense of what education is, can, and should be; quality 
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control and monitoring; and accumulation, synthesis, dissemi- 
nation, and use of cross-national knowledge about education. 



Research Design, Analysis, and Dissemination 

Current approaches to the design and analysis of interna- 
tional studies are inadequate to show how much various edu- 
cational inputs and processes contribute to students' learning 
and later occupational endeavors and to estimate the effective- 
ness of these inputs and processes in different environments. 

In such analyses, it remains important to find better ways to 
take into account factors not under the control of education 
decision makers, such as students' family background and neigh- 
borhood setting. More generally, there is a need to be thoughtful 
and explicit about the underlying theories for comparative edu- 
cation research. 

It is also important in both the design and dissemination 
phases of a study, to consider researchers who may wish to 
carry out secondary analyses of the data. Secondary analyses 
of large education studies frequently make major contributions 
to the literature and to policy concerns. For example, using 
data from the public-access data base developed at the Univer- 
sity of Illinois at Urbana-Champaign for the Second Interna- 
tional Mathematics Study (SIMS), Westbury (1992) compared 
mathematics achievement in the United States and Japan. He 
examined curriculum and achievement in grade 7/8 algebra 
and grade 12 elementary functions and analysis (calculus). He 
found that the curricula in the United States are not as well 
matched to the SIMS tests as are the curricula of japan, a situa- 
tion that results in lower achievement in the United States. In 
grade 8 algebra classes, however, the U.S. curricula are compa- 
rable to the "curriculum" of the tost and the Japanese curricu- 
lum, and U.S. achievement is similar to that of Japan. His 
finding that the difference between Japanese and U.S. achieve- 
ment is a consei.|uence of different curricula is very different 
I'Yqi'p earlier analyses of SIMS, which concluded that U.S. stu- 
dents performed poorly in every grade and in every aspect of 
mathematics tested when compared with students in the othei 
19 countries in the study (Crosswhile et al., 198(->). He con- 
cludes that analysis focused on the undifferentiated variable of 
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"country" as a unit of analysis, which has been used in studies 
like those of tne lEA or the lAEP. needs to be rethought to 
provide more emphasis "on analytic \'ariables defining the prop- 
erties of school systems that are common across countries but 
that might he distributed in different ways in different places" 
(p. 23). 

Therefore, in designing studies, consideration should be given 
to fostering ways to increase the opportunities for the research 
community to do secondary analyses by (1) using well-estab- 
lished methods of analysis or (2) clarifying methodological in- 
novations to enhance their understanding and use. It is also 
crucial for comparative data to be made available to the educa- 
tion research community in a timely and effective manner, since 
most researchers may not be affiliated with the organization 
collecting the comparativ'e data and so will not ha\'e early ac- 
cess to the data. It should be possible to establish a data bank 
in which all published data from international education stud- 
ies are entered and to make the data bank widely available to 
anyone with a computer and a modem. 

It is equally important to make a\'ailable to a wide audi- 
ence discussions in nontechnical terms of the primary research 
questions addressed by cross-national studies. Thek’ presen- 
tations should spell out the advantages and disadvantages of 
alternative designs to provide answers to the research and policy 
questions posed. The topics co\'ered in such a public discus- 
sion should also include the \ alidity of the measures used in 
the designs and the possibilities for including outcomes other 
than student achievement. In clarifying issues that have arisen 
in previous studies, it is important to distinguish between the 
objecti\’es and \’alue of cross-sectional studies and longitudinal 
studies at id to clarify the ad\'antages and disad\ antages of ex- 
amining cumulative achie\'ement le\'els over examining change 
in achie\'ement le\'els within a gi\'en time period (such as a 
school year). Publishing methodologically oriented reports that 
ha\'e a common theme, namely the design and analysis of cross- 
national educational studies, or sponsoring training institutes 
on this subject, would contribute both to better understanding 
of their value to the countries concerned and to influencing the 
design of future studies. 
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Methods for Assessing Current and 
Desired Outcomes of Education 

The research questions investigated in a country are often 
shaped by the methods used. Just as the global community 
provides a natural laboratory for comparing different educa- 
tion goals, systems, and methods, so it provides a variety of 
traditions and approaches to educational measurement. In the 
United States, since researchers have historically made much 
use of standardized multiple-choice tests of cognitive outcomes, 
research has emphasized ways to improve the kinds of learn- 
ing that can be measured in that way. Some European coun- 
tries have made greater use of essay examinations or perfor- 
mance assessments and have established research traditions that 
have placed less emphasis on reliability and objectivity as de- 
fined in the United States. In still other parts of the world, 
education scholars and policy makers have placed more em- 
phasis on less tangible schooling outcomes, including personal 
and social values, character, and the ability to communicate or 
cooperate. 

Cross-national studies are under pressure to draw on this 
plurality of methods and traditions, and at the same time they 
have been challenged to discover ways to quantify those kinds 
of learning for which good measures have not yet been found. 
Specific areas in need of investigation include: (1) reliable and 
valid performance-based measurement of cognitive learning 
outcomes across subject areas and grade levels; (2) measure- 
ment of personal values and other affective goals of schooling; 
(3) measurement of the abilities to communicate and cooperate 
as well as other schooling outcomes that are manifested only 
in a social context; (4) measurement of context variables at the 
level of class, school, neighborhood, and society, rather than 
the individual student; (5) measurement of schooling processes, 
including in particular a student's opportunity to learn not only 
content knowledge but also strategies for learning. 

In planning a cross-national study, consideration snould be 
given to whether it will serve its intended purpose. In particu- 
lar, e\'aluation is required of its intended and likely unintended 
social consequences. Although it may not be possible to iden- 
tify all the social consequences of an assessment, Messick (U)88) 
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has suggested contrasting the potential social consequences of 
a proposed assessment with those of alternative procedures, 
including not testing at all. This type of appraisal contributes 
to a consequential basis of test validity and should preclude 
some of the problems in the use of international data. 



Comparability Across Nations 

In making cross-cultural comparisons, in addition to value 
and cultural issues, both logical and measurement problems 
arise in defining and implementing fair and meaningful prac- 
tices. Two subcategories are important: first, primarily techni- 
cal questions, for which different languages and practices com- 
plicate the problem of procucing valid comparative information 
but do not, in principle, complicate the definition of sensible 
comparison groups or of the variable to be measured. As an 
example of a primarily technical problem, consider the com- 
parison of per-pupil expenditures. Different education fund- 
ing policies, accounting conventions, and currencies may com- 
plicate the development of comparable cross-national statistics. 
Economists have spent a large amount of time on this problem 
and have addressed it in great detail. Following the lead of 
quantitative economists, it should be possible to reach consen- 
sus on what should or should not be included as an education 
expenditure. In resolving such questions, useful models from 
other fields may include such international classification codes 
as the Standard International Trade Classification and the In- 
ternational Standard Industrial Classification of All Economic 
Activities. Effort should be directed to further development of 
such codes with a common language to describe and discuss 
educational organizations, processes, and outcomes so that cross- 
national measures and analyses of these elements can be im- 
proved. 

At a second level, there are deeper substantive questions, 
for which different languages and practices may lead to in- 
commensurabilities, making it difficult even to coiiccphinlizc 
variables representing corresponding attributes of students, 
practices, and institutions in different parts of the world. A 
problem in this category is the comparison of u'riting profi- 
ciency across languages. Problems of translations per se are 
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difficult enough, but, beyond translation, languages have dif- 
ferent conventions for organizing prose and presenting ideas. 

Comparisons among countries can be difficult to analyze 
because of the large number of differences in the countries 
being compared. The large number of interactions between 
variables makes it difficult to identify which variables influ- 
ence outcomes and which are cox'arying with those that influ- 
ence the outcomes. Both the problem of covariation and the 
problem of interaction cause difficulties in making interpreta- 
tions in comparati\'e studies. These difficulties in drawing con- 
clusions from comparisons do not mean that comparisons should 
be ignored — there are many useful advantages afforded by such 
investigations as discussed earlier in this report. 

In cross-national research, such issues of what constitutes 
an intelligent comparison could be more readily addressed if 
some studies were focused on specific topics within a few par- 
ticipating countries instead of omnibus studies welcoming as 
many countries as wish to join. For example, limiting the countries 
in a study to a few developed countries in Europe and North 
America (or to groups of de\ eloping countries, African coun- 
tries, Asian countries, or South American countries) would re- 
duce the number of differences between countries being com- 
pared, making it easier to identify which \ariables influence 
outcomes. Conceptualizing variables representing attributes 
of students, practices, and iiistitutions would also be easier for 
a limited study than for a worldwide study. Finally, if the 
study were focused on a few topics, for example, teaching practices 
and student achie\ement in secondary school chemistr\', the 
topics could be explored in greater depth than in a stud\- with 
countries ha\'ing verv disparate education systems. 

In addition, a limited study would have fewer problems 
v\'ith languages, culture, and \alue systems; would ha\'e fewer 
communication problems in study administration; would re- 
quire less training; v\'Ould be less costly; and could be coni- 
pk’ted on a niore timeh' basis. Such a study could also be' 
designed to meet the policy needs of the participating coun- 
tries. 
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Qualitative Studies and Large-Scale Surveys 

Many significant questions in comparative education are 
best addressed by small, focused studies, which may draw on 
a broad range of techniques and provide a deeper, richer sense 
of what education is, can, and should be. Thus, in addition to 
large-scale surveys, there is a need for a wide range of other 
cross-national research, such as ethnographic studies, case studies, 
small-scale focused quantitative and qualitative studies, and 
historical studies that would allow us to understand what it 
means to be educated in diverse settings around the world. 
Such studies go beyond the exploratory and the descriptive. 
They have become essential parts of the explanatory repertoire. 
These studies provide ways of analyzing and explaining a va- 
riety of processes, conditions, and contexts. They help to un- 
cover patterns of interaction and to interpret complex situa- 
tions both in the classroom and in the larger community. There 
is a great need for small, in-depth studies of local situations 
that would permit cross-cultural comparisons capable of iden- 
tifying the myriad of causal variables that are not recognized 
in large-scale surveys. In fact, much survey data would re- 
main difficult to interpret and explain without the deep under- 
standing of society that other kinds of studies provide. Given 
that research in cross-national contexts benefits from increased 
documentation of related contextual information, it would be 
useful to combine large-scale surveys and qualitative methods. 

Ethnographic and other qualitative studies are especially 
important in clarifying the perspectives of many diverse groups 
of learners and their teachers. Such groups include gifted and 
talented students, individuals with disabilities, racial and eth- 
nic minorities, women, and religious groups that reject the state's 
secular systems of education. 

But there is also a role for the large-scale surveys. About 
the only way to obtain a simple numerical comparison of a 
large number of countries on a common set of measures is 
with a large-scale survey, l.arge-si ale studies also permit cur- 
riculum analysis on a scale that could not possible be done 
adequately by a tew independent researchers, because such 
studies require a high degree of international organization and 
strueture. I'or example, the preliminarx’ curriculum analyses 
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of data collected by lEA in the Third International Mathemat- 
ics and Science Study (TIMSS) (Schmidt, 1993) reveal a large 
and interesting variation in mathematics and science textbooks 
across a large number of countries — variation that can be help- 
ful in better understanding the role of the teacher in various 
countries. Textbooks can have a major influence on teachers' 
curricular decisions (Schmidt et al., 1987). Teachers are more 
likely to teach the topics included in the textbook than others 
not included. Large-scale studies such as TIMSS or the OECD 
indicators project will also provide trend data, and indepen- 
dent researchers are unlikely to have the commitment, longev- 
ity, or resources to produce such data in adequate fashion. 

Improving Quality Control and Monitoring 

Due to the lack of continuity in funding and personnel as 
well as the lack of an organizational structure capable of main- 
taining rigt^rous quality control, the overall quality of some 
large-scale cross-national studies ot educational achievement 
has suffered. In manv countries, the quality of the sampling, 
the translation of instruments into the national language(s), 
and the collection and management of data have been impec- 
cable, but in other countries errors ha\'e been made in one or 
more of these processes. The results have been damaging in 
two respects: on one hand, suspect conclusions have been ac- 
cepted, and on the other hand, critics of large-scale studies 
ha\*e ox'ergeneralized and exaggerated these faults and asserted 
that nothing in the whole enterprise is valid or to be believed. 
For example, whereas in some countries, exclusions from tar- 
get populations mav ha\ e been substantial enough to mislead 
the user about the effects of a gi\ en country's schcn^ling poli- 
cies and practices, such exclusions can be clearly identified in 
reports and, in man\' cases, shown not to be so extensi\ e as to 
affect conclusions drawn about the country as a whole. 

Flence increased attention to controlling all sources of er- 
rors is important. This includes such matters as defining com- 
parati\ e populations, constructing sampling frames and select- 
ing samples, de\'eloping instruments and maintaining cross- 
national equixalencv of instrumentation, administering instru- 
men’.s and recording data, entering and editing data, ccKling 
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and scoring, and weighting and analysis. Documentation on 
the steps taken to control errors is essential at all stages: at the 
planning stage, during data collection as a guide to study per- 
sonnel in all locations, and as a necessary part of reporting 
what was done. 

Fostering Accumulation, Synthesis, and Dissemination 

Dissemination and utilization of international education data 
remain weak links in the information-reform connection within 
education. Public discussion of cross-national education re- 
search is frequently superficial or incorrect or both. The use of 
international data in the United States needs close scrutiny. In 
the past, test results were often extracted from a study and 
reported independently of other \'ariables that pro\'ide essen- 
tial context for the results. Sometimes the limitations, such as 
sampling problems, were glossed over as if they did not mat- 
ter, and at other times they were exaggerated as if they were 
sufficient to rebut everything that could be learned from such 
studies. In the future, researchers and organizations respon- 
sible for cross-national studies need to begin early in project 
cvcles to plan for public and professional discussion of the 
results and ti^ improve the presentation of tindings to all con- 
cerned. Press conferences should be planned that respond to 
the needs of journalists and at the same time present a more 
in-depth background on what has been done. These meetings 
should elarifv the importance of considering x'ariables such as 
demographics, expenditures, and teacher training in conjunc- 
tion with achie\*ement scores in presenting the results of the 
incTeasinglv sophisticated research on education that is under 
wav or alreadv a\ ailable. 

In addition to a better understanding ot how and wliat to 
communicate, consideration is needed of the potential contri- 
butions of new communication technologies and data bases to 
the planning of high-qualitv cross-national studies and to the 
dissemination and utilization of results. 1 he rapidity and sim- 
plicity of communication bv facsimile and by electronic net- 
wcM’ks (e.g., 131 I NI- 1 and Internet) hav e rewdutioni/ed interna- 
tional research in the last fi\ e years. As cross-national studies 
produce items and instruments, it will be important to con- 
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sidor liovv nil the information generated by such studies might 
he made more accessible through electronic communication net- 
works. 

The presentation and interpretation of current results could 
be impro\’ed if there wore an easily accessible repository of 
cross-national research. Students of education— from under- 
graduate prospective teachers to senior researchers \\. highly 
specialized subfields — ought to have readily at hand a litera- 
ture (good research published in reasonable places) and associ- 
ated data bases that would give them access not just to a de- 
scription of the structure of other education systems, but to an 
understanding of how such systems work, with particular em- 
phasis on how context influences school organization, teaching 
practices, and learning outcomes. 

A CHALLENGE TO REALIZE THE VISION 
AND A POSSIBLE APPROACH 

The introduction described a xisitm c'jf what international 
comparative research and data collection might produce in the 
next 20 vears. It is questionable, however, whether existing 
organizations w'ithin the United States or international organi- 
zations possess the full infrastructure required to accomplish 
the vision that we ha\e projected. 

Improving the Infrastructure for (!ross-National Research 

There is a need either to expand the role of existing organi- 
zations for cross-national research in education or to create 
new c>nes. The ideal u'cnild be something similar tc^ what was 
enxisioned originalh' in the late l^)40s tor the education sector 
of UNESCO— a forum in which the best ideas on education 
could be researched and shared, in which jointly financed projects 
could be identified and appraised, and in which professionals 
from man\’ disciplines could discuss results, publish freely, and 
assi'ss the strengths and weaknesses of such work. UNESCO 
did not carry out this mandate because manv member states 
placed a low' prioritv on the importance ot education research, 
a situation that severeh’ limited the fiscal and personnel re- 
sources axailable for the activity. 
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In short, what is needed now for education is similar in 
many respects to what is already available in epidemiologic 
research through the World Health Organization (WHO); de- 
mographic research through the United Nations Population Fund 
(UNFPA); and food plant research through the Consultative 
Group for International Agricultural Research (CGIAR). Pre- 
requisite to achieving such an infrastructure would be to di- 
versify the institutional relationships beyond those that now 
typify education research and, in particular, to incorporate the 
views of not only recognized scholars in diverse disciplines 
but also such parties as business and labor leaders, educational 
managers and teachers, and a wide range of political authori- 
ties. 

Nongovernmental agencies comprise a critical segment of 
this infrastructure. Priority should be given to developing centers 
of excellence, whether in universities or elsewhere, that are 
independent of policy imperatives. Such centers, given appro- 
priate support, could be a catalyst for identifying and training 
people with the right skills and sensitivities. Ultimately it would 
be desirable to have a netwcirk of education research centers 
that would enable scholars from around the world to under- 
take, more readily than is now the case, cross-national studies 
in societies other than their own. 



A Possible Approach 

Since the task of establishing a more coherent and effective 
worldwide system for cross-national research and data collec- 
tion in education will be neither straightforward nor easy, it 
must be shared among many organizations in many countries. 
One possible approach would begin with consultations and al- 
liances among stakeholders and other interested parties; first 
steps in this direction are the two conferences described in the 
preface. These consultation meetings should result in a report, 
perhaps issued jointly by sex’eral organizations or agencies, on 
what a better infrastructure to conduct cross-national studies 
in education might look like, what it might cost, and what it 
might produce. Before its release, ideas from the report should 
be shared with senior pc)licy makers whose interests in educa- 
tion are known. Discussion should take place at ministerial 




37 



iKrr.RSAnosAi cowparativi: studils /.v i:i)hcatr)\‘ 

level, since government ministers clearly do have interest in 
these matters, especially the matter of policies, and if possible 
should include heads of government. The purpose of the dis- 
cussion would be to interest the ministers in building the ca- 
pacity for meeting these information needs. 

The ultimate goal to be pursued through consultation and 
the formation of alliances would be the establishment, mainte- 
nance, and improvement of networks, organizations, and other 
institutional mechanisms internationally, within the United States, 
and in other nations for funding, managing, conducting, and 
disseminating cross-national educational studies. Sound cross- 
national research and data collection require stable institutional 
mechanisms, both to secure the cooperation of different na- 
tions and to ensure adequate, reliable funding for technically 
sound planning, execution, analysis, interpretation, and dis- 
semination. 

These mechanisms must also be designed in such a way 
that the education community identifies and prioritizes the re- 
search issues, questions, and topics to be investigated. The 
infrastructure would provide a forum for education research- 
ers to deliberate research agendas and priorities, as well as the 
objecti\es of specific studies. Priority projects could be se- 
lected from any of the three categories of projects described 
earlier in this report: 

• Projects to dc'X'elop and produce' education ineiicators; 

• Comparative' e'ducation assessme'iits (with associate’ei e'x- 
planatory research anei curriculum analyses) that are’ better or- 
ganized, with more justifiable and precise objectix es, more valid 
designs anei measures, more' rigorous equality control and more' 
adee]uate funding, anei coneiucted on a regular basis; anei 

• Other types of studies that can help interpret much of 
the variation revealed through e'ducation indicators anei cross- 
national assessment data, as well as investigations of other com- 
parative questions and issues. 

The agendas would serve both of the purposes for interna- 
tional educational research identified earlier in this paper; (1) 
long-term development of knowledge and (2) knowledge for 
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policy makers. Knowledge for policy makers can be derived 
either from studies to respond to particular policy needs for 
data or from policy-rele\'ant data not tied to anv specific cur- 
rent issue (e.g., data provided by education indicator systems 
featuring regular, recurrent data collections to permit analysis 
of trends). Education researchers can, do, and should respond 
to information needs connected to current policy questions. A 
sound infrastructure w'ould also pro\'ide a mechanism for chan- 
neling and responding to policy-relevant questions. 

In summary, the process of establishing a more coherent 
and effecti\'e worldwide system for cross-national research and 
data collection in education will have to be one that takes into 
account the views of interested parties, the technical and sub- 
stantive state of the art, and the promise of cross-national studies 
for responding to policy needs and advancing knowledge. 
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